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AOOVSM 

A General Computer Program for Analysis of Covariance 
Structures Including Generalized MANOVA" 1 " 

1* Introduction 

In a previous paper, JBreskog ( 1970a) developed a method for estimating 
a model involving structures of a very general form on means, variances and 
covariances of multivariate observations. With this method, a great deal 
of generality and flexibility is achieved in that the method is capable of 
handling most standard statistical models as well as many nonstandard and 
complicated ones. The purpose of this paper is to describe a computer 
program for this method. 

When the variance-covariance matrix of the observed variables is un- 
constrained, the method may be used to estimate location parameters and 
to test linear hypotheses about these. For example, the program may be 
used to handle such standard problems as multivariate regression) ANOVA 
and MANOVA, although there may not be any advantage in using this particu- 
lar program as compared to other existing programs. It can also be used for 
generalized MANOVA in the sense of Potthoff and Roy (1964), Khatri ( 1966 ) 
and Grizzle and Allen ( 1969 ) (see also Rao, 1959; 1965; 1966 , 1967; Gleser 
and Olkin, 1966 ). A unique feature is that the method can be used 
also when the variance -covariance matrix is constrained to be of a certain 
form. In this case one can estimate the covariance structure as well as 
location parameters and, in large samples, one can test various hypotheses 

^This research has been supported in part by grant NSF-GB-12959 from 
the National Science Foundation. 
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about the structure of the variance -covariance matrix. This is useful in 
many areas and problems particularly in the behavioral sciences. For 
example; one can handle such problems as analysis of congeneric tests, 
factor analysis, analysis of multitrait -mult imetbod data, analysis of sim- 
plexes and circumplexes ; analysis of multitest -multioccasion data and growth 
data in general, analysis of mixed and random effects MOVA and MANOVA, path 
analysis and linear structural equations (Jfrreskog, 1970a-b, 1971)* Vari- 
ous other models involving correlated errors or errors of measurement can 
also be handled. 



1.1 The General Model 

The general model considers a data matrix X(N x p) of N observations 
on p variates and assumes that the rows of X are independently distributed, 
each having a multivariate normal distribution with the same variance -covariance 
matrix Z . It is assumed that 

e(x) = a=p , (i) 

where A(N x g) = (a ) and P(h x p) = (p . . ) are known matrices of ranks 

C&S tl 

g and h , respectively, g < N , h < p and ~(g x h) = (£ ) is a matrix 

of parameters; and that Z has the form 



Z = B(A$A' + \|r 2 )B’ + © 2 



( 2 ) 



where the matrices B(p x q) = (P^) ; A(q x r) = ) , the symmetric 

matrix $(r x r) = (<t> ) and the diagonal matrices \|r(q x q) = (8 f ) 

mn xtj_ k. 

and ©(p x p) = (6. .0.) are parameter matrices. 

1^] 1 
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Thus the general, mode. 1 is one where means, variances and covariances 
are structured in terms of other sets of parameters that are to be estimated. 
In any application of this model, p , N and X will be given by the data, 
and g , h , q , r , A and P will be given by the particular applica- 
M tion. In any such application we shall allow for any one of the parameters 

in 3 , B , A , $ , \|r and © to be known a priori and for one or more 
subsets of the remaining parameters to have identical but unknown values. 

Thus parameters are of three kinds: (i) fixed parameters that have been 

assigned given values, (ii) constrained parameters that are unknown but 
equal to one or more other parameters and (iii) free parameters that are 
unknown and not constrained to be equal to any other parameter. 

The computer program estimates the free and constrained parameters of 
any such model by the maximum likelihood method and provides a test of good- 
ness of fit of the whole model against the general alternative that P is 
square and S and -Z are unconstrained. A test of a specified model 
(hypothesis) may be obtained, in large samples, by computing the maximum 
likelihood solution under the two models and then setting up the likelihood 
ratio test (see 1„5)* In the special case when both S and Z are 
unconstrained, one may test a sequence of hypotheses of the form 

^ CED = 0 , (3) 

where C(s x g) and D(h x t) are given matrices of ranks s and t , 
respectively. 
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1.2 Identification of Parameters 

Before an attempt is made to estimate a model of this kind the identi- 
fication problem must be examined. The identification problem depends 
on the specification of fixed, free and constrained parameters. 

It should be noted that if B is replaced by BT.^ , A by T-jAT^ , 
2 2 

$ by T^T^ and V k;y while © is left unchanged, then £ 

is unaffected. This holds for all nonsingular matrices T-^(q x q) and 
Tg(r x r) such that T^ is diagonal. Hence in order to obtain a 

unique set of parameters and a corresponding unique set of estimates, some 
restrictions must be imposed. In what follows it is assumed that all such 
indeterminacies have been eliminated by the specification of fixed and 
constrained parameters. To make sure that all indeterminacies have been 
eliminated, one should verify that the only transformations T^ and T^ 
that preserve the specifications about fixed and constrained parameters are 
identity matrices. 

1.5 Matrices U , V and W 

Since H may be large, the matrices X and A are not stored in the 
computer. Instead the information provided by these matrices is summarized 
in three matrices U , V and W defined as follows: 



u(g x g) = (l/N)A'A 


0) 


v(g X p) = (l/N)A'X 


(5) 


w(p X p) = (i/n)X’X 


(6) 



1.4 Standard Case 



It is convenient to distinguish between two different cases as follows 
Standard Case: Both H and Z are unconstrained. 

Nonstandard Case: Otherwise. 

In the standard case ; the maximum likelihood estimates of 5 and Z 



are 



u~ 1 vs" 1 p , (ps 1 p«) 



-1 



(7) 



Z = S + Q'UQ , 



( 8 ) 



where 



S = W - V'U 



■h 



(9) 



and 



Q = U 



- §P 



( 10 ) 



To test the hypothesis C3D = 0 against CHD / 0 one uses 
S = D , (PS~ 1 p , )~ L D , 



S h = (C§P)'(CRC')" X (CHD) , 



( 11 ) 

( 12 ) 



where 



R = U _1 + QS _ 1 V , u "' 1 



(13) 



,-l 
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Largest Root = 

t 

Sum of Roots = Z A. 

i=l 1 

t 

Likelihood Ratio = 1/11 (l + A.) 

i=l 1 

The largest root test, due to Roy (1953); can be used with Heck T s 

(i960) tables. The sum of roots test is due to Lawley (1938) and Hotelling 

(l95l)* The likelihood ratio test is an extension of Wilks* (1932) A -test 

and can be used with correction tables provided by Schatzoff (1966). When 

N is large ; -[N - g - (p - h) - (t - s + l)] times the likelihood ratio 

2 

is approximately distributed as X with st degrees of freedom. 

It should be noted that if P is square and nonsingular ; formulas 
(7); (8) ; (10) and (12) reduce to the ordinary formulas for MAWOVA ; i.e. ; 



9 = tf-Vp- 1 (7a) 

E = S (8a) 

Q = .0 (10a) 

S h = (CED) , (OT" 1 C , )~ 1 (® D ) • (12a) 

1*5 Nonstandard Case 



In the nonstandard case ; the logarithm of the likelihood; except for 
a constant tem ; is given by 

log L = -(N/2){l0g|z| + tr[T(5)z“ 1 ]} , 
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where 



T(r-) = (l/N)(X -AEP)'(X - AEP) 

= W - P’E'V - V'HP + P'E'UEP • (15) 

The maximum likelihood estimates are computed numerically by minimizing 
F(5,B,A,$,\|»,0) = logiz| + tr[T(E)Z _1 ] 



using a modification of the method of Fletcher and Powell (1963) (see 
Gruvaeus and J6reskog- ; 1970)* However; the minimization method is not ap- 
plied directly to P but instead to 



0) = min F( E, B, A,<S>, \|r, 0) 

= y , 3 ® } V ®) > 

where minimizes F for given E « If E is unconstrained; 

§ = U'-Vz^P^PZ -1 ?')" 1 



(16) 



(17) 



but this formula cannot be used if 5 contains fixed and/or constrained 
elements. Nevertheless; E can easily be evaluated since; for given E ; 

4j 

F is quadratic in S . The minimization of f takes into account the 
specification of fixed; free and constrained parameters. During the minimiza- 
tion? P is regarded as a function of the independent parameters Q l = (0^; 

9 2 ’ ; Say ‘ 

The minimization method is a rapidly converging iterative method that 
makes use of exact first-order derivatives and a symmetric matrix E of 
order m x m . Initially E is obtained as the inverse of the information 
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matrix c(b f/dodo 1 ) evaluated at the starting point. In subsequent itera- 
tions E is improved^ using information built up about the function; so 
that ultimately E converges to an approximation of the inverse of 
5 f/dod6 r at the minimum. When the minimum has been obtained; the inverse 
of C(d f/dodo') is computed again to give an estimate of the variance- 
covariance matrix of the estimators. This is used to obtain standard errors 
of the estimated parameters. 

/\ S\ 

Three different estimates S ; T and Z of Z are computed. 

S is defined by ( 9 ) and is the maximum likelihood estimate under the 
condition that P is square and nonsingular and Z is unconstrained. 

A . A . 

T is the matrix T (E y ) evaluated at the minimum of F . If Z is 
constrained; this estimate is not necessarily of the form (2). 

Z is the overall maximum likelihood estimate of Z computed from (2) 
and evaluated at the minimum of F . 

A /\ 

If Z is unconstrained; T and Z are identical. Otherwise; resid- 

/\ 

ual variances and covariances are defined as the elements of T - Z . 

Let Hq be any specific hypothesis concerning the parametric struc- 
ture of the general model and let be an alternative hypothesis. One 

can then test against by means of the likelihood ratio technique. 

Let Fq be the minimum of F under and let F^ be the minimum of F 

under • Then F^ < Fq and minus two times the logarithm of the likeli- 

hood ratio becomes U(Fq - F^) . Under .this is distributed; in large 
2 

samples; as a X distribution with degrees of freedom equal to the dif- 
ference in number of parameters estimated under and • 
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2. The Program 

f 

In this section we describe briefly what the program does. Details | 
about the input and output are given in sections 3 and k respectively. [ 

r 

t 

2.1 What the Program Does | 

The input data may be the partitioned matrix (x/A) , from which tip 
matrices U , V and W are computed (see 1-3), or the matrices U , jv and 
W , read in directly. In the standard case, other data matrices are P|, 

C and D (see l-l). ' 

In the nonstandard case, the user can request an accurate or an a££|roxi- 

mate solution. If an accurate solution is requested, the iterations of fthe 
minimization method are continued until the minimum of the function is 
found, the convergence criterion being that the magnitude of all derivatives 
be less that .00005- The solution is then usually correct to three signifi- 
cant digits. If an approximate solution is requested, the iterations termi- 
nate when the decrease in function values is less than 5$- The approxir|.ate 

solution may be useless but the residuals and the value of X 2 . will us|a.Lly 

\ . 

give an indication of how reasonable the hypothesized model is. The opvion 
of an approximate solution has been included in the program for the purpose 
of saving computer time in exploratory studies where the primary purposp 

F 

to find a reasonable model. Once such a model has been found, an accurate 
solution may be computed. In the standard case, the user can test a sej- 
quence of hypotheses of the form CHD = 0 for given U , V , W , P 

C and D (see l.l). [ 

A variety of options for the printed output is available. In the jion- 

^ standard case, residuals may be printed, which are useful for judging tjhe 

ERJC 
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goodness of fit of the model to the data. These are the mecn residuals 
defined as 

V - UEP 

and the residuals for 1 defined as 

/S /\ 

T - E 

o 

X is printed as an overall goodness of fit test statistic and standard 

errors for the estimated parameters may he requested. In the standard case, 

if testing the hypothesis CED = 0 , the largest root, the sum of roots and 

the likelihood ratio, as described in section 1.^ will he printed. The 

2 

large sample transformation of the likelihood ratio to a X is also 
printed. 



2,2 How Fixed, Free and Constrained Parameters Are Specified 

This section only applies to the nonstandard case (see 1.5)* Since 
specifications for 5 are slightly different from the specifications of 
the other parameter matrices, B , A 3 $ , \|r and 0 , they will be 

described separately. 



) 




Specifications for B , A , $ , \[r and 0 

The elements of the five matrices are ordered as follows. The matrices 
are assumed to be in the order B , A , $ , \[r and 0 and within each 
matrix, the elements are ordered row-wise. The diagonal matrices \|r and 
0 are treated as row vectors. 

For each of the five parameter matrices, a pattern matrix is defined, 
with elements 0, 1, 2 and 3 depending on whether the corresponding element 
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in the parameter matrix is fixed; free; constrained follower and constrained 
leader ; respectively. A constrained parameter is called a constrained 
leader the first time it appears in the sequence. The parameters appearing 
later in the sequence and assumed to be equal to the constrained leader are 
called constrained followers. 

The above technique defines uniquely the positions of the fixed; free 
and constrained leader parameters. It does not define; however; which 
followers go with which leader; if there is more than one leader. To do 
so one must also specify all the followers associated with a given leader. 
This is done by assigning to each leader and follower a five-digit number 
MRRCC; where M defines the matrix in which the constrained parameter 
appears ( M = 1 for B ; 2 for A ; 3 for $ , k for f and 5 for © ); 
and HR and CC are the row and column position of the parameter in the 
matrix. For example; 



10101 10201 103Q1 20k03 

defines p^ ~ &21 = P 31 = ^43 where p^ is the leader and p^ , P-^ 

and are the followers. Such a string of numbers has to be provided 

for each leader. 

Pattern matrices have to be provided for each matrix containing both 
fixed and free parameters and for each matrix containing constrained param- 
eters. Patterns for parameter matrices whose elements are all fixed or all 
free are set up by the program. 

We give a simple example to illustrate the above specifications. 
Suppose A(2 x 2) = I ; i|/(2 x 2) = 0 and 
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“ 






_ 








P 11 


0 






9 1 


0 


0 


0 


P 21 


0 


, [i 1 




0 


e 2 


0 


0 


0 


P 5 2 


■ 1? 4 


0 = 


0 


0 


0 3 


0 


0 


P 42_ 






0 


0 


0 


CD 

4=- 



with - P 21 j P^ 2 = P^ 2 , 9 ± ~ d 2 ’ 6 3 = 6 k ‘ The P attern matrices 

for B , <£ and 0 are 



B 



3 0 
2 0 
0 3 
0 2 



p » = E o] p 9 - e 2 3 3 



and the specifications of leaders and followers are 



10101 10201 
10J02 10402 

50101 50102 
50103 50104 

In this model five independent parameters will be estimated. 

Specifications for g 

The pattern for « is defined in the same way as the patterns for B , 
A 9 , 0 . To specify what follower is associated with a given 

leader ; a five-digit number MERCC is assigned to each leader and follower 
as described above ; with the one difference that M is always equal to 1 
since we are dealing with only one matrix. A pattern matrix for r, must 

always be provided even i f the elements of ~ are all free or all fixed. 

In addition to the above specifications for fixed; free and constrained 
parameters; start values have to be given for all parameters; except for 
those parameter matrices which are of standard form; i.e., B = I , A = I ; 
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0=I ; ^ = 0 , 0=0. Start values for 5 are not read in if none of 

its entries are fixed. The start values define the fixed parameters and 
initial values for the minimization procedure for the other parameters, 
except for 5 , whose initial values are set by the program to be equal to 
zero. Constrained parameters that are assumed to be equal must be given 
the same start values. Otherwise, initial values may be chosen arbitrarily 
but the closer they are to the final solution the less computer time it 
will take to reach this solution. 

2.5 Limitations 

The program is written in FORTRAN IV -G and has been tested on the 360/65 
at Educational Testing Service. Double precision is used in floating point 
arithmetic throughout the program. With minor changes the program should 
run on any computer with a FORTRAN IV compiler. In computers with a single 
word length of 36 bits or more, single precision is probably sufficient. 

Limitations as to the number of free and constrained parameters the 
program can handle and the storage requirements on the IBM 36o/65 are given 
in the following table. The given storage requirements assume the program 
is overlayed. 

Max. no. of variables 15 

Max. no. of free and constrained parameters 60 

Storage requirement ( K = 1024 bytes) 132K 
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2 . k Availab ility 

A copy of the program may be obtained, upon written request. The user 
must provide a tape on which the program will be loaded. The program will 
be written on the tape with 80 characters per record. The tape will be 
unlabeled. The user must specify whether he wants the tape blocked or 
unblocked, in EBCDIC or BCD mode, as well as the density, parity and track 
required. Test data will be at the end of the program. The test data are 
described in the Appendix. Anyone using the program for the first time 
should make sure that the test data run correctly. 

2.5 Disclaimer 

Although the program has been working satisfactorily for all data 
analyzed so far, no claim is made that it is free of error and no warranty 
is given as to the accuracy and functioning of the program. 
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3 . Input Data 

This section is divided into two parts. The first part will describe 
the input data for the standard case. The second part will describe the 
input data when the nonstandard case is considered (see 1.5). 

In both cases, whenever a matrix or vector is read in it is preceded 
by a format card, containing at most 80 columns, beginning with a left 
parenthesis and ending with a right parenthesis. The format must specify 
floating point numbers for the input and parameter matrices, and fixed 
point numbers for the pattern matrices, consistent with the way in which 
the elements of the matrix are punched on the following cards. Users un- 
familiar with FORTRAN are referred to a FORTRAN Manual, where format rules 
are given. Matrices are punched row-wise, each row beginning on a new 
card. For the symmetric matrices only the lower half of the matrix should 
be punched. The elements above the diagonal are automatically set by the 
program. 

Part I: Standard Case 



For 


each data to be analyzed, the input consists 


of the 


following 


1. 


Title card 






2. 


Parameter card I 






3. 


Rows of (X/A) (i.e. raw data to compute U 


, V , 


w ) 


k. 


Data matrices U , V , W 






5. 


Data matrix P 
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6. Parameter card II 

or 1 blank card followed by the next data set (either for the 

standard case or the nonstandard case) 

or 1 blank card followed by a STOP card (see sec. 3*7) 

7* Matrices C and D 
8. Repeat steps 6 through 7 

Sections 3*1 through 3*8 describe in general terms the function and setup 
of the above quantities. 

3.1 Title Card 

Whatever appears on this card will appear on the first page of the 
printed output. All 80 columns of the card are available to the user. 



3*2 Parameter Card I 

All quantities on this card except for the logical variables must be 
punched as integers right -adjusted within the field. 

cols* 1-5: sample size ( N ) ; i.e.^ number of observations 

cols. 6-10: number of variables ( p ) ( £ 15 ) 

cols. 11-15: rank of A (g) ( < 15 ) 
cols. 16-20 : number of rows in P (h) (< 15 ) 

col. hi: logical indicator which determines whether U , V ; W 

are computed from (x/A) or read in as input data 
col. hi: = T ; if rows of (x/A) are read in to compute 

U , V , w 

col. 4l: = F ; ifU ; V , W are read in as input 

data 
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col. 42: logical indicator which determines whether the data matrix 

P is equal to the identity or not 
col. 42: = T- , if P = I (Note: only if h = p ) 

col. 42: = F , if P f I 

col. 43: logical indicator which determines whether the same U , 

V 9 W as used in the previous data set will he used 
(never true for the first data set) in which case 
neither (X/A) nor U , V , W needs to be read in 
as input and col* 4l will be ignored 
col. 43: = T , if new U , V , W are analyzed 

col. 43: = F , if same U , V , W as previous data 

set are analysed 

3.3 Rows of (X/A) 

Omit if col. 4l or col. 43 of parameter card I is false. Otherwise 
the partitioned matrix (x/A) is read in like any other input matrix. 

That is, it is preceded by a format card, read in row-wise where each 
row consists of a row of X immediately followed by a row of A , and 
a new card is started for each new row of (x/A) . 

3.4 Data Matrices U , V ? W 

Omit if col. 41 of parameter card I is true or if col. 43 is false. 
Otherwise read in U , V , W respectively, each preceded by its format 
card. Since U and W are symmetric only their lower triangular parts, 
including the diagonal, are read in. 
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3*5 Data Matrix P 





Omit if col. 


42 of parameter card I 


is true. Otherwise read in P 


preceded by a format card. 




3.6 


Parameter Card II 






All quantities on this card must be 


integers right -adjusted within the 


field. 








cols. 1-5: 


number of rows in C 


( s ) ( < 15 ) 




cols. 6-10: 


number of columns in 


D ( t ) ( < 15 ) 


3-7 


Matrices C 


and D 






Matrices C 


and D are read in consecutively, each preceded by its 


format card. 






3.8 


Stacked Data 







The steps described in sections 3.6 and 3*7 can be repeated as many 
times as desired or they can be skipped altogether. The end of each 
standard data set must be followed by a blank card . This set can then 
be followed by a new data set, either for the standard case or the non- 
standard case. Any number of such data sets may be stacked together and 
analyzed in one run. Note : since the program looks for a blank card, any 

input cards for matrices with all zero rows should have the zero entries 
punched, i.e., do not use a blank card in lieu of all zero entries on an 
input card. 

After the last set of data in the stack, there must be a card with the 
word STOP punched in columns 1-4 . 

O 
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Part II: Nonstandard 


Case 




For 


each data to be analyzed^ the input 


consists 


of the following 


1 . 


Title card 






2. 


Parameter card 






3- 


Starting matrix E 






4. 


Specifications for E 






5- 


Rows of (x/A) 






6. 


Data matrices U } V } W 






7- 


Data matrix P 






8. 


Pattern matrices for B } A } $ , 


\|/ and 


© 


9. 


Equalities 






10. 


Start values for B } A } ^ 


and © 




11. 


New data set or STOP card 







3 . 9 Title Card 

Whatever appears on this card will appear on the first page of the 
printed output. All 80 columns of the card are available to the user. 

3.10 Parameter Card 

All Quantities on this card except for the logical variables must be 
punched as integers right -adjusted within the field. 

cols. 1-5: sample size ( N ), i.e v number of observations 

cols. 6-10: number of variables ( p ) ( £ 15 ) 
cols. 11-15: rank of A .( g ) ( £ 15 ) 

cols. l6-20: number of rows in P (h) (£ 15 ) 
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cols. 21-25: number of columns in B ( q. ) ( < 15 ) 
cols. 26-50: number of columns in A (r) ( < 15 ) 
cols. 51-35: total estimated execution time in seconds for all 

stacked data (SEC). This should be a number slightly 
less than the time requested on the control cards so 
the program -will have time to print and/or punch results 
up to that point. (Note: SEC should be read in for 

each nonstandard data set and should be the same for 
all such data sets in the stack. ) 
logical indicators (see below) 
integer indicators (see below) 

logical tape (disk) number of a scratch tape (disk) used 
in the program in the nonstandard case 
Logical Indicators (cols. 41-4*5) : The logical indicators control the 

input as described below. 

Column hi determines whether U , V , W are computed from (x/A) 
or read in as input data. 



cols . 41-4-5 

cols. 51-54 
cols. 61-65 



col. 4l: = T j if rows of (x/A) are read in to compute U , V , W 

col. 4l: = F , if U , V , W are read in as input data 

Column 42 determines whether the data matrix P is read in or set 
equal to the identity matrix by the program. 

col. 42: = T , if P = I (note: only if h = p ) 

col. 42: = F , if P is read in as input data 

Column 45 determines whether data matrix 5 ■ is read in or not. If no 



elements in ^ are fixed^ 5 is not read in. 
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col. 43: 


= T , 


if 5 


is read in as input data 


col. 43: 


= F , 


if 5 


is not read in 



Integer Indicators (cols. 51-54)* J 

f 

Column 51 determines the type of printed output wanted. Thin can be 
standard output ( S ), parameter specifications ( R ) ; the matrices T , 

T , Z and residuals ( C ), and technical output ( D ). (See 4. 2-4. 5 .) 
col. 51s = 0 , for S 

col. 51 5 = 1 j for S + R 

col. 51 : = 2 } for S + C 

col. 51s = 3 , for S + R + C 

col. 51: = 4 for S + D 

col. 51 2 = 5 y for S + R + D 

col. 51 : = 6 3 for S + C + D 

col. 51: = 7 > for S + R + C + D 

Column: 52- -determines whether the same U. , V } W as used in the 
previous data set will be used (never true for the first data set) in which 
case neither (x/A) nor U , V } W need be read in as input ( G )* It 
also determines certain extra printed or punched output. This can be 
standard errors ( F ) and a punched solution ( P ). (See 4. 6-4.7*) 



col. 52 : 


= 


0 


y 


if nc 


1 extra 


col. 52 : 


= 


1 




for 


F 


col. 52 : 


= 


2 


> 


for 


P 


col. 52 : 


= 


3 


> 


for 


F + P 


col. 52 : 


= 


4 


> 


for 


G 


col. 52 : 


= 


5 




for 


F + G 
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col. 52 : 


= 6 , 


for 


p 


+ G 


col. 52 : 


= 7 ; 


for 


F 


+ P + G 



Column 53 determines whether an accurate or an approximate solution 
is required, 

col. 53 : = 0 ; if an exact solution is required 
col. 53* = 1 ; if an approximate solution is required 
Column 54 will be set to zero or left blank for ordinary purposes, 
col. 54: = 0 ; iterate and obtain all output requested through 

columns 51 a nd 52 

col. 54: = 1 ; no iterations (This may be used if one wants to test 

the goodness of fit of a solution which is completely 
specified.) 

col. 54 • = 2 ; no standard output 

5.11 Starting Matrix 5 

Omit if col. 43 of the parameter card is false,, otherwise read in matrix 
S preceded by its format card. The program will set all free and constrained 
elements to zero ; so only the fixed values read in are relevant. 

5.12 Specifications for 5 

A pattern matrix for 5 is read in preceded by a format card (see 2.2). 
Note: this matrix is read in even if 5 is not. The pattern matrix for S 
is followed by "equality” cards ; i.e. ; cards which determine which elements 
are followers and which are leaders (see 2.2). These "equality" cards are 
omitted if there are no elements equal to 2 or 3 in the pattern matrix for 
- . Otherwise^ starting in column 1 punch the five digit numbers MRRCC 
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as described in section 2.2. For each new constrained leader start a new 
card. M is always equal to 1 on the "equality " cards specifying S . 

The last entry on each "equality" card is a zero indicating more "equality" 
cards follow, or a two indicating it is the last one . 

3.15 Rows of (X/A) 

Omit if col. 4l of the parameter card is false or if col. 52 is greater 
than three. Otherwise, the partitioned matrix (x/A) is read in like any 
other input matrix. That is, it is preceded by a format card, is read in 
row-wise where each row consists of a row of X immediately followed by 
a row of A , and a new card is started for each new row. 

5.14 Data Matrices U , V , W 

Omit if col. 4l of the parameter card is true or if col. 52 is greater 
than three. Otherwise read in U , V , W respectively, each preceded 
by its format card. Since U and W are symmetric, only their lower 
triangular parts, including the diagonal, are read in. 

5.15 Data Matrix P 

Omit if col. 42 of the parameter card is true, otherwise read in matrix 
P preceded by a format card. 

5.16 Pattern Matrices for B , A , $ , \|r and 0 

These pattern matrices are preceded by a data card with entries in 
columns 1-5, the column defining the matrix in question, 1 for B , 2 for A , 
3 for $ , 4 for \[r and 5 for 0 . 
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cols. 1-5: GCCCC where C = 0 > if the matrix is fixed 

C = 1 ; if the matrix is free 

C = 2 } if the matrix has mixed values 

A pattern matrix should he provided only when C = 2 (see 2.2)* 

For example^ if columns 1-5 a ^e punched 20100; the matrix B contains 
mixed values; A is all fixed; 0 is all free; \|r and 0 are all fixed* 
In this case only a pattern matrix for B is read in. 

The pattern matrix consists of a format card specifying an I -format 
and subsequent cards with the integer entries of the parameter matrix. 

5.17 Equalities 

Omit if the pattern matrices for B ; A 3 $ ; \| r and 0 do not con- 

tain any elements 2 or 3. Otherwise starting in column 1 punch the five- 
digit numbers MRRCC as described in section 2.2. For each new constrained, 
leader start a uiew- card The ALast- entry -on each^-iequality" card is a zero 
indicating more "equality" cards follow, or a six indicating it is the 
last one . The example in section 2.2 would then have the following 
equality cards: 
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10101102010 

10302104020 

50101501020 

50103501046 

3.18 Start Values for B , A , $ , \jr and 0 

The start values are preceded by a data card with entries in columns 
1-5, the column defining the matrix in question. 

cols. 1-5: CCCCC where C = 0 , if the matrix is of standard form 

C = 1 , otherwise (see 2.2) 
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This card is then followed by the necessary start values, for matrices with 
C = 1 ; each matrix or vector with its own format card. 

3 * 19 Stacked Data 

In sections 3*9 through 3*18 we have described how each set of non- 
standard data should be set up. Each such set of data can be followed by 
another data set, either for the standard case or the nonstandard case. 
( Note : a blank card does not indicate the end of a nonstandard data set-- 

this is only true for the standard case (see 3*8)0 

After the last set of data in the stack, there must be a card with the 
word STOP preceded in columns 1-4 . 
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4. Printed and Punched Output 

The output consists of a series of printed and punched tables as de- 
described in sections 4. 1-4. 7 . Section 4.1 describes the output obtained 
when the standard case is considered. All subsequent sections deal with 
the various output options open to the user when considering the non- 
standard case. 

4.1 Output for the Standard Case 

The output for the standard case consists of the title with parameter 

A A 

listing, the matrices U , V , W , the matrices P , 5 , 2 and S 

A 

(if h = p £ is not printed since 2 = S). Matrices C , D , S^ , S^ 

(see 1.4) and the three test statistics--the largest root, sum of roots, 

2 

likelihood ratio and X are printed when testing the hypothesis CHD = 0 . 

The parameter listing gives the information supplied on parameter 
card I. 

4.2 Standard Output ( S ) for the Nonstandard Case 

The standard output is always obtained regardless of the value punched 
in columns 51 and 52 of the parameter card (see 5.10). The standard out- 
put consists of the title with' parameter listing, the matrices U , V , 

W , P and S , the final solution and the result of the test of goodness 
of fit. 

The parameter listing gives the information supplied on the parameter 

card. 
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The final solution consists of six matrices E } B , A } $ ; 7 

A 

and 0 . All numbers are printed with three decimals. 

2 

The test of goodness of fit gives the value of X and the correspond- 
ing degrees of freedom. The probability level is also given. This is de- 

2 

fined as the probability of getting a X value larger than that actually 
obtained, given that the hypothesized structure is true. 

Just above the table giving the final solution, the following message 
is printed 



'INI = X. 1 

Usually X is 0, but if, for some reason, it has not been possible to 
determine the final solution, X will be 1, 2, 3; 4 or 5* if INI) is 
1, 2 or 3; "serious problems" have been encountered and the minimization 
of the function cannot continue. One reason for this may be erroneous 
input data. Another reason may be that a point has been found where the 
matrix X is not positive definite. A third reason may be that insuf- 
ficient arithmetic precision is used. If INI) is 4, the number of itera- 
tions has exceeded 250. If INI) is 5, the time limit SEC has been 
exceeded (see 3«10). If INI ^ 0 , the solution obtained so far is auto- 
matically punched on cards. Each of the six matrices are preceded by a 
format card, so that they can immediately be used as initial estimates for 
a new run with the same data. Thus there is little loss of information 
when execution is terminated with INI / 0 . 
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K»3 Parameter Specifications ( R ) for the Zonstandard Case 

If column 51 of the parameter card is 1, 3, 5 T; a table of param- 
eter specif i cations, containing the information provided by the pattern 
matrices (see 2.2), is printed. Six integer matrices are printed corre- 
sponding to S , B , A ; 0 , \|r and 0 . In each matrix an element 

is an integer equal to the index of the corresponding parameter in the 
sequence of independent parameters. The matrix E has a sequence of 
independent parameters and the matrices B , A , $ , \|r and 0 to- 
gether form a second sequence of independent parameters. Elements cor- 
responding to fixed parameters are 0 and elements corresponding to the 
same constrained parameter have the same value. Examples are given in 
the Appendix. 



k.b Matrices T P , Z and Residuals ( C ) 



I f _coJjurrui 51of the parameter card is 2, 3; 6 or 7; "the matrices T 

/ _ _ \ cl ^ 2 a /\/\/\ , /n 2 a /\/\/\ 

(see 1.5), r = AOA f + , Z = BPB + © , the mean residuals = V - UEP 



and the residuals for Z = T - Z are printed. The matrices T , V and 

A /\ 

Z are computed from the final solution. If the fit is good, Z should 

A 

agree with T and the residual matrix should be small. Elements of the 
residual matrix may suggest how the hypothesized structure should be 
modified to obtain a better fit. All five matrices are printed row-wise, 
each element with four decimals. 



4.3 Technical Output ( D ) 

If column 51 of the parameter card is 4, 5; 6 or 7, the technical out- 
put is printed. This consists of a series of tables that describe the 
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behavior of the iterative procedure and give various measures of the ac- 
curacy of the final solution. Ordinary users will have little interest 
in these tables. 

The first table of the technical output gives the initial estimates 
for E , B , A , $ , \|r and 0 . 

The next two tables show the behavior of the iterative procedure under 
the steepest descent iterations and under the following iterations by the 
Fletcher and Powell method. For interpretation of these tables the reader 
is referred to Gruvaeus and Jttreskog (1970). If something goes wrong, so 
that IND is 1, 2 or 3 (see 4.2), these tables may contain valuable 
information. 

4.6 Standard Errors ( F ) 

If column 52 of the parameter card is 1, 3, 5 or 7; large sample 
approximations to the standard errors of the estimated parameters are 
printed. These are printed row -wise in matrix form and each number is 
printed with three decimals. The reader is referred to the paper by 
Jttreskog (l970a) for information about how the standard errors are obtained. 

4.7 Punched Output ( P ) 

If column 52 of the parameter card is 2, 3, 6 or 7j the final solu- 
tion is punched on cards. These cards are punched in matrix form. Each 
matrix is preceded by a format card and each row of the matrix begins a 
new card. 
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Appendix 

We shall illustrate how input data are set up and what the printout 
looks like by means of two small sets of data. These data also serve as 
test data to be run when the program has been compiled on another compu- 
ter. The various models and hypotheses have been chosen to illustrate 
the possibilities available in the program rather than the statistical 
problems involved. 

Both sets of data are analyzed in one run. Pages A6-A9 show card 
by card how the input is punched. One line corresponds to one card. 

Pages A10-A36 show the corresponding printout obtained. 

The first set of data is taken from Smith, Gnanadesikan and Hughes 
( 1962 ) and consists of N = ^5 observations on two covariables and p = 11 
biochemical response measurements. The subjects were individuals classified 
into four weight groups. For further information about the subjects and 
the measurements, see the above reference and references therein. 

The model is 

G ^45x11^ ~ ^ 5 x 6 “ 6 x 11 > 

i.e., 3? llxll = I . The first four columns of A are used to classify 
individuals into weight groups and the last two consist of the measurements 
of the covariables. We do an ordinary MANOVA (standard case) and test the 
two hypotheses, that the first row of E is zero and Iig that rows 

2^ 3 and h of E are all zero. These correspond to the hypotheses that 
the overall mean effect is zero and that there is no difference between 
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weight groups^ respectively. For both hypotheses we have = ^ ’ 

for we have 

c lx 6 = d ° ° ° ° °) 



and for we have 



/o 1 0 0 o o\ 



C 3x6 = 1 0 0 1 0 0 0 

\o 0 0 1 0 



For the analysis we use the raw data published in tables 2 and 5 of 
Smith et al. (1962). 

The second set of data is taken from Potthoff and Roy ( 1964 ) and is 
used to illustrate the standard case with P rectangular (h < p) and 
also the nonstandard case with both 5 and L constrained. It consists 
of measurements on 11 girls and 16 boys at 4 different age levels. 

Two analyses of these data are done. The input for the first analysis 
is the matrices U , V and W . Here we assume that Z is uncon- 
strained and that 



e ^ x 27xlp - A 27 x2 = 2x3 P 3x4- ' ( ' Alj 

where A is a matrix of zeros and ones with ones in column 1 for girls 
and ones in column 2 for boys and where 





111' 
-113 
1 1 9 _ 
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The rows of HP represent two quadratic growth curves, one for girls and 
one for boys. We test two hypotheses and is that the co- 

efficients £ and £ - of the second-order terms are zero, i.e., that 
13 

the growth curves are linear rather than quadratic; is that the two 

growth curves are the same, i.e., that the two rows of H are identical. 
This amounts to choosing C and D as follows: 



For H 1 : C 2x2 " 1 D 3xl m (° 



For Hg = C lx2 = (1 -1) 

D, - = I 
3x3 

The second analysis uses the same U , V and W as used previously 
and assumes that Z has a quasi-Markov simplex structure with equal error 
variances (see Jtireskog, 19J0, section 5*6) • This may be represented as 

z = AM' + e 2 i , 



where 



A = 



\i ° 

V 0 

0 

0 
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'42 



0 = 



1 1 
Lp 1 



and 0 is a scalar. In terms of (2) this is specified by choosing B 



4x4 



= i , 



Ax2 = ^ ’ ^2x2 = ® > t = 0 and 0 constrained to have all diagonal 
elements equal. The model (Al) is the same but we now assume that 
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^13 = ^23 = 0 9 5 11 = S 21 and £ 12 = £ 22 . This analysis yields maximum 

likelihood estimates (accurate solution) of £ ^ = ^ 2 ^ ^ i^ 2 = £ 22 } 3 

^21 ; ^32 3 ^42 3 P 3 ® and an overa ll test of goodness of fit* 

In the nonstandard case various time estimates are printed on the 
output. The time shown is the time taken to compute the solution that 
follows the time estimate. This time includes only the iterations and not 
the time for printings except for the technical printout if requested. 
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